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(54) IMAGE PROCESSOR 
(57)Abstract 

PROBLEM TO BE SOLVED: To attain improvement in the quality of a 
digital camera by finding the blurring state of an image from a parameter 
inputted by a parameter input means and adding a blurring effect to an 
image inputted by an image input means corresponding to that found 
blurring state. 

SOLUTION: An image input means 2 stores single physical data, which 
have depth information for the unit of a two-dimensional color tone data 
of the image, in an image memory 6. Besides, respective set values are 
inputted from a parameter input means 3, a quality or lens setting part 4 
and a focal position designating means 5 to a virtual camera parameter 
conversion calculating part 7. Then, input data from that image memory 
6 and a virtual camera parameter from the virtual camera parameter 
conversion calculating part 7 are inputted to an image calculating part 8, 
the blurring state of the image is operated and corresponding to that 
blurring state, the blurring effect is added to the image inputted by the 
image input means 2, 



3 



war-* 



_JSE¥S 



http://www1 9 .ipdLinpitgo jp/PA1 /result/detail/main/wAAAzZaGonDA41 2207549P1 .htm 



2009/11/25 



JP,2000-207549,A [CLAIMS] 



Page 1 of 2 



* NOTICES * 

JPO and INPIT are not responsible for any 
damages caused by the use of this translation. 

IThis document has been translated by computer. So the translation may not reflect the 
original precisely. 

2.**** shows the word which can not be translated. 
3. In the drawings, any words are not translated. 



CLAIMS 

[Claim(s)] 

[Claim 1]An image processing device comprising: 

An image input means which is an image processing device which adds the dotage effect 
according to a focusing state to a captured picture supposing the characteristic of a virtual 
imaging optical system, and incorporates picture information including distance information to 
each portion of a photographic subject. 

A parameter input means to input a parameter which can derive an effective diameter and a 
focal distance of an assumed imaging optical system. 

A focusing position setting means which specifies a focusing position of an imaging lens 
assumed [ above-mentioned ]. 

Distance information inputted by a described image input means, and a focusing position 
specified by the above-mentioned focusing position setting means, An image processing 
means which fades in a picture inputted by a described image input means from a parameter 
inputted by the above-mentioned parameter input means corresponding to a dotage state 
searched for by dotage state calculating means which searches for a dotage state, and the 
above-mentioned dotage state calculating means, and adds an effect. 

[Claim 2]An image processing device comprising; 

An image input means which is an image processing device which fades to a captured picture 
and adds an effect, and incorporates picture information including distance information to each 
portion of a photographic subject. 

An image processing means which adds the dotage effect by overwrite in order from a portion 
of a picture which has distant distance information in a picture inputted by a described image 
human power means. 
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[Claim 3]An image processing device comprising: 

An image input means which is an image processing device which fades to a captured picture 
and adds an effect, and incorporates picture information. 

The 1st operational mode that fades in a part of picture inputted by a described image input 
means, and adds an effect. 

An image processing means with the 2nd operational mode that fades into both the remaining 
image portion and adds an effect. 

A displaying means which can display a picture which added a switching means which can be 
switched to the 2nd operational mode of the above from the exterior, and dotage from the 1st 
operational mode of the above for operational mode of a described image processing means. 



[Translation done.] 
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* NOTICES * 

JPO and INPIT are not responsible for any 
damages caused by the use of this translation. 

LThis document has been translated by computer. So the translation may not reflect the 
original precisely. 

2.**** shows the word which can not be translated. 
3. In the drawings, any words are not translated. 



DETAILED DESCRIPTION 

[Detailed Description of the Invention] 
[0001] 

[Field of the lnvention]This invention relates to an image processing device applicable to the 
digital camera which has high efficiency as a virtual camera, for example. [0002] 
[Description of the Prior Art]Recently, with osmosis of a home computer (PC), and highly- 
efficient-izing of PC, the digital camera for **** intermediary individuals is developed by the 
camera using the conventional silver halide film, and the comparatively high-class digital 
camera which moreover carries CCD over 1 million pixels is also sold. 
[0003]This high definition digital camera is copied to the high definition display device more 
than VGA, or is copied to the large-sized printer more than A4, and is the best for the use to 
enjoy. 

[0004]Simultaneously, the image processing technique used only for a special research use, or 
movie production and printing operation can realize [ a computer / low cost / home use ] now 
conventionally with improvement in a miniaturization and low power consumption of computer 
technology, and image processing capability. 

[0005]Conventionally, it miniaturizes, and low power consumption of the computer (CPU) 
which was expensive and large-sized can be carried out, and it can carry now in the inside of a 
digital camera. 

[0006]ln a digital camera, if high definition CCD, for example, 800,000 pixels, and 1,300,000 
pixels become small [ to about 1/4 inch ] from 1/2, a lens also becomes small, an F value will 
be large and a focal distance will become small. 

[0007]Even if a digital camera also becomes deep and the depth of focus is not expensive and 
highly precise AF function a digital camera, the image which the focus had from the 
neighborhood to a distance is increasingly acquired by this. 

[0008]On the other hand, in the digital camera, the problem that only the same picture is 
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acquired even if who takes has come out. 

[0009]namely, -- choosing a diaphragm and shutter speed arbitrarily in the camera using a 
silver halide film like a comparatively high-class single-lens reflex camera - Seki, although it 
was possible to float a prudent object, or to have faded on the outskirts and to have added the 
taste, Pleasure peculiar to such a photograph is impossible in a small digital camera. 
[0010] However, these SUBJECT can be solved by using an image processing technique. 
[001 1]For example, in "modeling of the dotage characteristic by vision and the both-eyes three 
dimentional display by it" (Kaneko etc.) of national conference P1 09-1 10 of Information 
Processing Society of Japan in 1990. Doing research which approximates the dotage function 
in vision to Gaussian distribution in the position of the retina reflected in an eye based on the 
depth information of a computer image, fades to a computer image, and flavors is indicated. 
[0012]lt is called filtering processing, a background is obscured using a high-pass filter, and 
making an image sharp using a low pass filter is well known for the field of computer image 
processing in the object. 

[0013]Here, the FURUTA ring processing by a high-pass filter is equalizing processing which is 
a means of - ** of image processing which averages the sexual desire news of the pixel 
around an interested pixel, and is transposed to the interested pixel. 

[0014]The FURUTA ring processing by a low pass filter is the emphasis processing of contrast. 

[0015]ln JP,6-118473,A, it calculates inside a camera so that it may fade also with a small 
camera and the taste may come out, and the function to take out warning, and the proposal 
which adjusts the distance of a camera so that the dotage taste may come out are made. 
[0016]ln JP,7-213657,A, input the condition information of image data, depth data, and the 
camera photoed to the actual conditions, such as an F value and a focal distance, and the 
virtual imaging parameter which the user set up simultaneously is set up independently, It 
fades from the input value, a parameter is calculated, and the method of using a low pass filter 
and a high-pass filter properly, and outputting a new image to an image memory by image 
processing from the comparison of the dotage taste from a preset value with camera 
information, such as an F value and a focal distance, is shown. 

[0017]The picture picturized in JP,9-181966,A using the imaging lens of the couple which has 
azimuth difference is inputted, distance information is computed based on the information, and 
the art which chooses F, f, and the dotage parameter containing any of a focus position they 
are, fades, and added the effect is indicated. 
[0018] 

[Problem(s) to be Solved by the InventionjHowever, although each conventional technique 
which was mentioned above is the intention to fade by image processing and to add the taste, 
It was equivalent to what adds filtering processing to the computer graphics which has data of 
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the conventional depth direction fundamentally, and it was that of ****** and was insufficient 
about giving high textures to the image of the deep focus of a future micro digital camera. 
[0019]For example, in JP,7-213657,A. Although give which information on F of the actually 
photoed camera, f, and a focus position, fade using F and f which were set up, and a focus 
position, the characteristic is calculated, a low pass filter and a high-pass filter are used 
properly and a new image is made by image processing, Since a actual image fades and it has 
the characteristic, it is impossible to acquire a sharp image from the state which faded with a 
low pass filter. 

[0020]When using a zoom lens, it is always difficult to give which information on F of a camera, 
f, and a focus position. 

[0021] In order to be dependent on the system and camera to be used, it is not easy for it to be 
special and to photograph compatibility, either. 

[0022]Since a low pass filter and a high-pass filter are faded by proper use, it is impossible to 
obtain high textures. 

[0023]Since input the picture by which the ****** image pick-up was carried out in JP,9- 
181966,A in the imaging lens of the couple which has azimuth difference, and distance 
information is computed based on that information, and that dotage parameter is chosen, it 
fades and an effect is added, for this request kana intermediary ****, Since the dotage 
parameter at this time contains any of F, f, and a focus position they are, the information on a 
camera is required for it too, it is [ that it is incompatible and ] special, and the dotage taste 
does not give high textures, either. 

[0024]Then, as a result of considering SUBJECT which is a long focus of the present digital 
camera by the artificer of this application, etc. and having examined the high textures, a next- 
generation function and requirements required for a digital camera are summarized as follows. 
[0025]- Cameras are having sufficient pixel number and a high definition of 800,000 pixels or 
more. 

[0026]- The focus be comparatively correct from infinite distance to the neighborhood. 

[0027]- There needs to be information on an objective depth direction. 

[0028]- In order to remove a noise, be the unit which settled per object. 

[0029]- Don't search for any camera information other than a picture and depth information. 

[0030]- Consider a field angle and lens information only as the time of setting out of a virtual 

camera. 

[0031]- The textures added by image processing should be a dotage taste, a color, reflectance, 
etc. 

[0032]- The dotage taste is determined based on the lens theory of a camera, and be natural. 
[0033]- The dotage taste, a color, reflectance, etc. are adjusted. 

[0034]lf above SUBJECT is not solved, it will be judged that utilization of the improvement in 
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textures of a digital camera is difficult. 

[0035]That is, in order to fulfill these conditions, realization of the digital camera system which 
can add textures is desired strongly. 

[0036]ln light of the above-mentioned circumstances, an object of this invention is to provide 
the image processing device which can be contributed to realization of the digital camera 
system which can add textures, such as dotage, by solving above SUBJECT and enabling 
utilization of the improvement in textures of a digital camera. 
[0037] 

[Means for Solving the ProblemJAccording to this invention, it is (1) in order to solve an 
aforementioned problem. The characteristic of a virtual imaging optical system is assumed, An 
image input means which is an image processing device which adds the dotage effect 
according to a focusing state to a captured picture, and incorporates picture information 
including distance information to each portion of a photographic subject, A parameter input 
means to input a parameter which can derive an effective diameter and a focal distance of an 
assumed imaging optical system, A focusing position setting means which specifies a focusing 
position of an imaging lens assumed [ above-mentioned ], Distance information inputted by a 
described image input means, and a focusing position specified by the above-mentioned 
focusing position setting means, A dotage state calculating means which searches for a 
dotage state from a parameter inputted by the above-mentioned parameter input means, An 
image processing device possessing an image processing means which fades in a picture 
inputted by a described image input means corresponding to a dotage state searched for by 
the above-mentioned dotage state calculating means, and adds an effect is provided. 
[0038](2) In order to solve an aforementioned problem according to this invention, an image 
input means which is an image processing device which fades to a captured picture and adds 
an effect, and incorporates picture information including distance information to each portion of 
a photographic subject, An image processing device providing in order an image processing 
means which adds the dotage effect by overwrite is provided from a portion of a picture which 
has distant distance information in a picture inputted by a described image human power 
means. 

[0039](3) In order to solve an aforementioned problem according to this invention, an image 
input means which is an image processing device which fades to a captured picture and adds 
an effect, and incorporates picture information, The 1st operational mode that fades in a part of 
picture inputted by a described image input means, and adds an effect, An image processing 
means with the 2nd operational mode that fades into both the remaining image portion and 
adds an effect, An image processing device possessing a displaying means which can display 
a picture which added a switching means which can be switched to the 2nd operational mode 
of the above from the exterior, and dotage from the 1st operational mode of the above for 
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operational mode of a described image processing means is provided. 
[0040] 

[Embodiment of the lnvention]With reference to drawings, an embodiment of the invention is 
described below. 

[0041](A 1st embodiment) A 1st embodiment of this invention is shown in drawing 5 from 
drawing 1 . 

[0042]First, while this 1st embodiment is shown, the principle of this invention shall be 
explained. 

[0043] Drawing 1 shows the composition of the basic technique of this invention, and here, 
Although the composition of the functional block is shown and any of software/hardware 
constitutions may be sufficient as this function, when based on a software configuration, Each 
functional block shall be memorized by the subroutine and the computer readable program 
storing medium which were object-ized and which is not illustrated as a unit of a command. 
[0044]The input output processing section 1 of drawing 1 as the input part of image data or a 
parameter, a treating part, and an outputting part, It has the three-dimensional (D) 
measurement data input part 2, the virtual camera set part 3, the set part 4 of textures or a 
lens, the virtual focus set part 5, the image memory 6, the virtual camera parameter transform 
calculation part 7, the picture calculation part 8, and picture (record) memory storage 9 grade. 
[0045]Here, the 3D measurement data input part 2 means the image input means 2 as only 
physical-properties data which had depth information in the two-dimensional tone data unit of a 
picture, the virtual camera set part 3 means the parameter input means 3, and the virtual focus 
set part 5 means the focusing position setting means 5. 

[0046]The input output processing section 1 has the means and the function to input each 
preset value from the parameter input means 3, the set part 4 of textures or a lens, and the 
focusing position setting means 5, based on the physical-properties data from this image input 
means 2. 

[0047]This image input means 2 could equip with the actual measuring camera, and the video 
information of an analog may be sufficient, and compressed data may be sufficient as it, and it 
has pointed out the suitable interface means. 

[0048]the user according to a picture as much as possible although a keyboard or a mouse 
may be sufficient as the parameter input means 3, the set part 4 of textures or a lens, and the 
focusing position setting means 5 - it is desirable that it is FRIENDLY composition. 
[0049] Although the image memory 6 is a memory memorized temporarily and has not 
described the picture input data from the image input means 2 here, it may have an interface 
circuit for defrosting of the image data compressed into the preceding paragraph of the image 
memory 6, data conversion, etc. 

[0050]The virtual camera parameter transform calculation part 7 is a part which carries out 
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transform calculation of the parameter input means 3, the set part 4 of textures or a lens, and 

the parameter of the virtual camera from focusing position setting means 5 grade. 

[0051 ]The picture calculation part 8 has a circle-of-confusion calculating means, a dotage state 

calculating means, and an image processing means, Predetermined computations, such as a 

circle-of-confusion operation later mentioned using the virtual camera parameter from the input 

data from the image memory 6 or the virtual camera parameter transform calculation part 7, a 

dotage state operation, and image-processing processing, are performed. 

[0052]The technique and algorithm which realize the means and function of this virtual camera 

parameter transform calculation part 7 and the picture calculation part 8 are the most important 

portion of this invention. 

[0053]Although the image memory 6 may be omitted, the picture (record) memory storage 9 is 

the composition of storing the result calculated by the picture calculation part 8. 

[0054]A deterministically different portion from the conventional example in this composition is 

explained. 

[0055]"First, JP,7-213657,A, camera information, such as image data, depth data, an F value, 
and a focal distance, is inputted from a camera, Set up a virtual imaging parameter 
independently, fade from the input value, and a parameter is calculated, It is the method of 
using a low pass filter and a high-pass filter properly, and outputting a new image to an image 
memory by image processing from comparison of the dotage taste of the actual condition from 
a preset value with camera information, such as an F value and a focal distance, and a 
calculation result." 

[0056]That is, it is the composition which inputs an image including the present conditions and 
dotage state of a camera, and newly makes an image in comparison with the conditions of a 
virtual camera. 

[0057]JP,9-181966,A is "the method of inputting the picture picturized using the imaging lens 
of the couple which has azimuth difference, computing distance information based on the 
information, choosing F, f, and the dotage parameter containing any of a focus position they 
being, fading, and adding an effect." 

[0058]ln this case, it is the composition of adding new photography conditions to the state of 
the present photograph containing the setups of a camera, performing image processing, and 
taking out the dotage taste. 

[0059]By this invention, following composition and effects are realized to these conventional 
examples. 

[0060]- It is only the image data photographed as video information with the three-dimensional 
measuring camera including a picture. 

[0061]- Set up virtual cameras, such as an F value, a focal distance, a diaphragm value, for the 
first time in the system of this invention. 
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[0062]- The performance of the lens by which a dotage state is characterized, the dispersion 
property of the color of a lens, the dispersion property of the atmosphere at that time, etc. can 
set up the dotage state function by distance, etc. suitably. 

[0063]- Finally a user doubles a focus with the object used as a target, and it becomes 
possible to enjoy a virtual camera. 

[0064]Next, the fundamental view of this invention is explained using drawing 6 from drawing 
2. 

[0065]Here, the radius (circle of confusion) of dotage when a focus is doubled with a certain 

position is estimated as a near value, and the characteristic is obtained. 

[0066] Drawing 2 shows the image formation state of the object before the focal position of a 

lens. 

[0067]Here, the position of the object with which, as for f, the focal distance of a lens and Zf 
doubled the focus, the distance of the place where a focal position and Z are observing Zfo, 
the distance by the side of the image formation of the place which Zo is observing, and D 
consider it as the effective radius of a lens, and let the starting point be the center of a lens. 
[0068]Here, in using combining two or more lenses, it assumes that it is a single lens. 
[0069]When the radius [ point / of the viewpoint Zf at the time of just taking an image formation 
face from a lens, and doubling a focus with Z here ] of dotage is set to d, it is a geometric 
expression of relations to d/(Zo-Zfo) =D/Zo. - (1) 
1/(Z)+(1/f) =1/Zo - (2) 
1 /(Zf)+(1/f)=1/Zfo- (3) 

When it ******** and calculates, it is d=D{(1/Zf) - (1/Z)}/{(1/Zf) + (1/f)}. 
-(4) 



********** 



[0070]Here, it is Zf<0 and Z< 0. 

[0071]When it is intelligible and the absolute value of Zf and Z is taken here, it is d=D{(1/|Z|) 
(1/|Zf|)}/{(1/f) + (1/|Zf|)}.-(5) 



********** 



[0072](a) of drawing 3 actually calculates this relation, and quantifies and shows it. 
[0073]Here, an f= 50-mm lens is assumed, and the value which calculated the focal position by 
three points (Zf=0.3m and 1m and 10m) is table-ized, and is shown. 
[0074](b) of drawing 3 graph-izes this calculation result, and shows it. 

[0075]Here, when a circle of confusion will become large extremely if a lens approaches 20 cm 
or less, and it sets up far away enough, it turns out that d/D is decreasing asymptotically. 
[0076]Next, a distant place is considered from the position whose focus suited. 
[0077]ln this case, it becomes an image formation relation as shown in drawing 5. 
[0078]By easy geometry, it is d/(Zfo-Zo) =D/Zo. - (6) 
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d=D{(1/Z)-(1/Zf)}/{(1/Zf)+(1/f)} 
-(7) 

********** 

[0079]Here, it is Zf<0 and Z< 0. 

[0080]When it is intelligible and the absolute value of Zf and Z is taken here, it is d=D{(1/|Zf|) - 
(1/|Z|)}/{(1/f) + (1/|Zf|)}.-(8) 

********** 

[0081](a) of drawing 4 actually calculates this relation, and quantifies and shows it. 

[0082]Here, an f= 50-mm lens is assumed, and the value which calculated the focal position by 

three points (Zf=0.3m and 0.6m and 2m) is table-ized, and is shown. 

[0083](b) of drawing 4 graph-izes this calculation result, and shows it. 

[0084]Here, if a few is left in the case of Zf=0.3m, while dotage will be expanded rapidly, when 

a focus is doubled with a 2-m distant place, it turns out that dotage does not spread. 

[0085]For example, Zf = in the case of 0.3 m, the radius d of a circle of confusion reaches 10% 

of D at 0.6 m, the twice, and the back expands to 20% asymptotically. 

[0086]On the other hand, in the case of Zf=0.6m, at least 1.2 m, the twice, is 5% of D, and d 

expands it to 10% asymptotically. 

[0087]The actual state of dotage appears, after (a) of drawing 3 , (b), and (a) of drawing 4 and 

(b) have combined. 

[0088] Drawing 6 shows this situation. 

[0089]Here, d rapidly expanded for a short distance when Zf was made into the distance with 
which the focus was doubled falls rapidly to Zf, and by Zf, if it becomes the minimum and Zf is 
exceeded, it will expand again rapidly to the twice of Zf, and will expand asymptotically after 
that. 

[0090]The value of d is calculable by such a quantitive analysis type. 
[0091]Thus, the size of the circle of confusion d of dotage can be set up virtually. 
[0092]Specifically, it is the focal distance f, effective caliber 2D, or 2D=f/F of a lens. - (9) 
It can determine in the f number and the distance with which the focus to set up is doubled 
using a ** type. 

[0093]That is, in this parameter, the information on a camera that the depth direction of a 
picture is taken is not contained at all. 

[0094]This is composition different deterministically [ JP,7-213657,A ]. 
[0095]That is, in the camera by JP,7-213657,A, only a picture and depth information are 
incorporated and setting out of subsequent camera conditions is performed only within an 
image processing device. 

[0096]Although the size of the circle of confusion d of dotage was considered by this invention, 
when expressing the actually natural dotage taste and depth perception, it is important to 
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decide the form of PSF (Point SpreadFunction) where dotage is expressed. 
[00971 Drawing 6 shows the dotage characteristic PSFn in the side near the lens experiential ly 
said with the common lens, and the dotage characteristic PSFf in a distant place. 
[0098] Drawing 7 shows the explanatory view of the PSF characteristic. 
[0099]Here, although (a) of drawing 7 is PSF in the Zfo side in the case of being nearer than 
Zf, it is in the tendency for the light volume of a periphery to increase generally. 
[0100]Although (b) of drawing 7 is PSF which a distant image makes rather than Zf, generally 
the shape of this PSF also changes greatly with lenses. 

[0101]Here, although the astigmatic chisel was considered, a coma aberration and a chromatic 
aberration come out actually, and it becomes complicated. 

[01 02] However, it is thought that expressing dotage automatically most sensuously is based 
on astigmatism without a coma aberration or a chromatic aberration. 
[0103]Since this astigmatism is symmetrical radially, if a concave as used a convex shape as 
shows this function form to (b) of drawing 7 as A type here and shown in (a) of drawing 7 is 
used as B type, If it indicates by a power function and is A type, it is gb(r) =Gb 

(a 0 + ai r+a 2 r 2 +a 3 r 3 ). -(10) 

If it is B type, it is gb(r) =Gb (l-b^-b^-b^ 3 ). - (11) 

Here, the range of -d<=r<=d outside is 0, and it is standardized by G so that the spatial 
capacity may be set to 1 . 

[01 04]Each coefficient is a coefficient which shows the form. 
[0105l Drawing 8 shows the flow of actual processing. 
[0106]lmage data is inputted in a step (S1). 

[0107]Although it has depth information although black and white and a color may be sufficient 
as this image data, and it is a pixel unit desirably, a block unit may be sufficient as it and an 
object unit may be sufficient as it. 

[0108]When compressed, thawing treatment is performed, it is made bit map format, and the 

picture is once stored in the image memory 6. 

[0109]Characteristic setting out of a lens is performed in a step (S2). 

[01 10]Usually, this processing can omit setting out by a user by setting up the default value. 

[01 1 1]Here, the characteristics of a lens are a dotage function, a kind of aberration, etc. 

[01 12]A camera parameter is set up in a step (S3). 

[01 13]Here, a camera parameter means diaphragm information when a lens is set up, and the 
information on zoom. 

[01 14]ln a step (S4), the focal information at the time of photography is set up. 

[01 15]That is, it is set up here where a focal distance is set up and with which position on a 

screen a focus is doubled. 
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[01 16]ln a step (S5), it fades from the distance information of a picture based on the preset 
value of a step (S2) to a step (S4), a function is calculated as follows, and the dotage state 
according to distance is added to image data. 
[01 17]- Determination of D. 

[01 18]- Investigate the relation of the coordinates of a focus and an object. 

[01 19]**(5) Calculate size d of a circle of confusion using a formula and (8) types. 

[0120]- Although a dotage function is expressed using (10) or (1 1) types, a numerical function 

may be sufficient as this function. 

[0121]- Fade and distribute the RGB intensity of each pixel using a function. 
[0122]- Calculate the dotage states of all the picture. 

[0123]A calculation result is expressed as a step (S6) on the screen which is not illustrated. 
[0124]Decision processing is performed based on the display on a screen, in a step (S7), if it is 
O.K., a picture is stored in the image storage 9, but in being NG, it returns from a step (S1) to a 
step (S4). 

[0125]According to this invention, from the above procedure and composition, the image 
processing device which can be contributed to realization of the digital camera system which 
can add textures is realizable by solving conventional SUBJECT and enabling utilization of the 
improvement in textures of a digital camera. 

[0126]This procedure is an example, turn may change, and a part may overlap, for example so 
that a step (S4) and a step (S3) may be set up together. 

[0127]The conversion process of the actual picture of a step (S5) may be calculated per pixel, 
may calculate a dotage function beforehand, and may make a look-up table, for example, may 
perform matrix calculation. 

[0128] Drawin g 9 shows an example of this calculation. 

[0129]ln a step (S1 1), the color picture of RGB which includes depth (Z) information in each 
pixel unit is inputted. 

[0130]ln a step (S12), dispersion doubled with devices, such as a memory and CCD, is 
performed. 

[0131]Usually, since it is dispersed as digital information in many cases at the input time of a 
step (S1 1), an interested (it calculates) field angle is decided in that case, and it is dispersed in 
it. 

[0132]Setting parameters are inputted in a step (S13). 

[0133]ln a step (S14), D, Zf, and f are extracted from setting parameters. 

[0134]ln this case, f computes D from lens information using an F value to (9) types. 

[0135]ln a step (S15), calculation is started by each pixel (i). 

[0136]First, the cell to start is chosen and d is calculated from Z value of D of a step (S14), Zf, 
f, and each pixel. 
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[01 37] In this case, since two d is computed from the relation between Z and Zf, this is 
prepared as d1 and d2. 

[0138]That is, when the absolute value of Z is smaller than Zf, d1 is used, and d2 shall be used 
when the absolute value of Z is larger than Zf. 

[0139]ln a step (S16), the dotage function acquired with the lens characteristic is prepared. 
[0140]With the convex function which is A type mentioned above, ga obtained from a1 using 
a3 grade is used for this, and gb obtained from b1 using b3 grade is used for it by the concave 
function which is B type mentioned above. 

[0141]ln using for distance the function which is not in dependence, it shall calculate at the 
time of a step (S1 3). 

[0142]ln being dependent on the difference of Z and Zf, it shall calculate each time. 
[0143]ln a step (S17), the dotage state in j point by Ri is calculated. 
[0144]ln this case, g shall be in the convex function which is A type which the dotage state 
mentioned above, or the concave function which is B type mentioned above, and shall kick ga 
and gb by ** like a step (S16). 

[0145]Usually, with the convex function which is A type mentioned above when closer to a lens 
than Zf, in being far, it shall use the concave function which is B type mentioned above. 
[0146]ln this case, since g is standardized as mentioned above, the value which integrated Ri 
to the value decided by distance of the coordinates of i and j turns into a value of j. 
[0147]Although only R was shown here, it shall carry out similarly about G and B. 
[0148]lt shall return to a step (S15) and this procedure shall be performed by all the pixels. 
[0149]ln a step (S18), since the dotage states of a certain point j are all the ranges which the 
dotage function of i point attains to, they are given by the sum of Rji about i. 
[0150]lt ends in a step (S19). 

[0151]By the above technique, the picture which added high dotage of impact etc. very 
automatically is acquired. 

[0152]However, some SUBJECT also occurs in detail. 

[0153](a) of drawing 10 shows the - **, and it is the "fogging" between the objects by the turn of 
processing. 

[0154]Here, in the trees 1 1 of the near person image 10 and distant place, a focus is doubled 
with a person, and although it is the example which added dotage to the trees 1 1 , dotage of 
the trees 1 1 is fogging also to the person 10. 

[0155]This is a "fogging" which produces processing since it processed in the trees 1 1 
direction from the person 10. 

[0156](b) of drawing 10 shows the means of solution of this "fogging." 

[0157]That is, as shown in (b) of drawing 10 , it is adding expression which divides into the 

object unit from which the depth differs first, places, fades in the object unit, and includes a 
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state. 

[0158]ln this case, a clear context can be given between each object by processing in an order 
from the object 12 with the deeper depth, and performing processing which overwrites the 
person 10 on it. 

[0159]And when piling up an object when [ it ] it differs from adding sexual desire news in this 

case for dotage or expression, it is necessary to change the method of addition. For example, 

when the object 10 close to - is focused, the sexual desire news of the distant place of the 

pixel is thrown away, and it transposes to the color of a near new object. 

[0160]- When the near object 10 is not focused, if required, carry out the rarefaction of a part of 

periphery, and add the color showing the dotage state of the object of a near object new to 

distant sexual desire news of the pixel. 

[0161](c) of drawing 10 shows other solving means. 

[0162]That is, since it has depth information per pixel as shown in (c) of drawing 10 , it is 
processing from a pixel with a big absolute value of Z. 

[0163]ln this example, processing is most carried out from a distant pixel by the object 12 of a 
mountain, and the trees 11 and the person 10 are processed in order. When the near object 10 
is focused also in this case, the sexual desire news of the distant place of that pixel is thrown 
away, and it transposes to the color of a near new object. 

[0164]- When the near object 10 is not focused, if required, carry out the rarefaction of the 
periphery showing the dotage state of the object in part, and add the color of a near new object 
to the sexual desire news of the distant place of the pixel. 
[0165]** - a part of processing [ like ] is necessity. 

[0166]lt is the figure shown in order that drawing 13 may explain the concrete processing in a 
1st embodiment from drawing 1 1 . 

[0167]Although this is an image in the screen of a actual computer, the liquid crystal display of 
a camera may be sufficient as it. 

[01 68] Drawing 11 is an example of the screen which sets up the characteristic of a lens first. 
[0169]The user takes care not to set up the information on a lens by putting in the default value 
beforehand. 

[0170]Three, a lens, aberration, and a dotage function, are set up in this example. 
[0171](a) of drawing 1 1 is Screen 13 which sets up a lens. 

[0172]ln this case, a lens shall choose either the single focus 16 or the zoom 17 first. 
[0173]And when a single focus lens is chosen, the f value 18 is put in, and when zoom is 
chosen, the f value of Max and Min is put in, but this may be put in numerically and it may be 
made to choose it. 

[0174]Next, the caliber 19 of a lens is put in similarly. 
[0175](b) of drawing 1 1 is a screen which sets up aberration. 
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[0176]First, it changes to the screen which sets up aberration by clicking the tag 20 of 
aberration. 

[0177]lt enables it to have chosen either the astigmatism 21 the coma aberration 22 or the 
chromatic aberration 23, and enables it to have chosen the kind here in the case of the coma 
aberration or the chromatic aberration. 

[0178]lf it enables it to have chosen the grade of the gap of the center if it is a coma aberration, 
and it is a chromatic aberration, it enables it to have chosen the strength of ingredients, such 
as red and blue, and the aberration of those. 

[0179]Although volume etc. may be used for this strength, it may be made to give the filter 
effect with the button of the special effects 24. 

[0180]For example, if a diaphragm is extracted in the case of a single-lens reflex camera, the 
polygon (hexagon) of this diaphragm works as a filter, and strong reflection will become this 
polygon and will appear on a screen. 

[0181]Such an effect and the case where a free filter is used for user itself can be assumed. 
[0182]lt can make it possible to acquire two or more effects simultaneously about setting out of 
each of this aberration. 

[0183]For example, ** BE ** and those effects can come out astigmatism and a coma 
aberration simultaneously. 

[0184]Although the coma aberration was chosen from some set-up patterns, it may enable it to 
set the parameter of a coma aberration for user itself here. 

[0185](c) of drawing 1 1 shows the function to set up the form of a dotage function (Point 
Spread Function), i.e., the unit spread function within a circle of confusion. 
[0186]Here, although only the most important astigmatic setting out is shown, it is possible to 
take the same technique also about a coma aberration or a chromatic aberration. 
[0187]Here, far dotage is shown as ****** 27 by making near dotage into ****** 26 rather than 
the focal agreement position. 

[0188]As a value of initial setting, although, as for ******, the value in which the central part is 
smaller than the circumference, and ****** shall set up the value with a larger center as a 
convex function than the circumference by a concave function, this is the characteristic of a 
lens and can be changed freely. 

[0189]Here, except for restrictions of the point that it is circular symmetry since the radius of 
the circle of confusion which a computer determines is astigmatic, a user can set up freely. 
[0190]lf a user specifies and drags the value of the radius (r) direction using a mouse, it will be 
made to be freely changed, although a number may be put in about the method of setting out. 
[0191]However, the integral value of a function is standardized so that it may become fixed. 
[0192]The function on a screen may differ from the actual calculative function. 
[0193]ln order to complain of a function form to intuition, G (r) may be sufficient, G(r)/r may be 
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sufficient, and G(r)/r may be sufficient. 

[0194l Drawing 12 shows the parameter setting (Step S3) of a virtual camera and focal position 
setting out (step S4) which were shown in drawing 8 . 

[0195]lt enables it to set it as simplification and a user on a single screen here for the ease of 
using. 

[0196]ln this case, the user can set up F value 28 and the focal position 29 by adjusting 
volume (28, 29) in this example. 

[0197]For example, if you would like to emphasize the dotage taste, an F value will be small 
set to 1.4. 

[0198]lf this value is set up, using the f value set up beforehand, D will be calculated using (9) 
types and it will be applied to (5) types and (8) types. 

[0199]Here, the image shown in drawing 12 is a screen for a monitor which is not frustrated. 
[0200]Since calculation becomes huge and time is taken until a result comes out when all the 
pixels are used as a screen for this monitor, a part of all the pixels shall be used. 
[0201]For example, when an image is 480x640 of VGA, thin this out to one fifth and it is 
referred to as 96x128, and this screen is quadrisected, for example (30). 
[0202]The 2nd and the 4th phenomenon take out the image before processing among this 
quadrisection, and the 1st and 3rd phenomenon takes out the image after processing. 
[0203]lf it is this pixel number, it can calculate in real time mostly and change can be checked 
in an F value or a focal position. 

[0204]This virtual camera can related completely determine an F value and a focus as a actual 
camera freely. 

[0205]lf setting out is completed as mentioned above, calculation of all the pixels will be 
started, a result will be displayed by operation of the complete button which is not illustrated, 
and printing and the memory to the memory storage 9 will be made by it if needed. 
[0206] Drawing 13 shows the example of the last image acquired with the parameter 
determined eventually in this way. 

[0207]Thus, as for the person 10 who doubled the focus, the spherical and natural dotage 
taste has come out of the trees 1 1 moderately distinctly again. 

[0208]This dotage taste can be freely changed by changing the form of an astigmatic dotage 
function, as mentioned above, and since the size of this dotage taste is based on lens theory, it 
is natural, and that extent is based on the character of a lens. 

[0209]in this case - a comparatively sharp lens - a gauss - it is functional, and a bright 
portion becomes spherical [ a soft lens ] and the taste comes out. 
[0210]lf a coma aberration is put in, the image of a periphery comes to flow into the 
circumference, it becomes a natural image which human being's vision catches comparatively, 
and this influence can also be set up freely. 
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[0211]Since the effect changes with physical development by depth perception especially, it is 
very natural. 

[0212]Although the place whose focus does not suit by dotage is in red or the situation shifted 
to blue, this phenomenon of the chromatic aberration is also visually natural, and it can acquire 
many effects. 

[0213](A 2nd embodiment) Drawing 14 shows a 2nd embodiment. 

[0214]this 2nd embodiment - a fundamental concept and constitution method are the same as 
that of a gestalt with the 1st operation. 

[02 15] Drawing 14 is an embodiment for drawing 12 mentioned above, and is the embodiment 
which strengthened the user interface. 

[0216]Here, at a 1st embodiment, although it is made to position a focus with a volume, since 
he is trying to already have distance information per pixel, if it is set as a place to double a 
focus with, the ** distance should become clear by a 2nd embodiment. 
[0217]ln this example, although an F value is set up in volume, the focus is doubled with the 
person's 31 head. 

[0218]Then, the depth information of the position of the head is calculated, Z is decided, the 
position 29 of the volume of the lower part of drawing 14 moves automatically, and a focal 
position is decided. 

[0219]Since there is that error per pixel, it may be made to average the distance of the 
specified neighborhood of a point, and may set up carry out this radius and number of pixels to 
average separately. 

[0220]Thus, if setting out is completed, calculation of all the pixels will be started, a result will 
be displayed by operation of the complete button which is not illustrated, and printing and the 
memory to the memory storage 9 will be made by it if needed. 
[0221](A 3rd embodiment) Drawing 1 5 shows a 3rd embodiment. 

[0222]The fundamental concept and constitution method of this 3rd embodiment are the same 
as that of a 1st embodiment. 

[02231 Drawing 15 is the embodiment which strengthened the user interface at the time of 
having a zoom function. 

[0224]Here, in a 1st embodiment, the zoom 32 is what determined the focal distance of the 
lens, and when ****** is this drawing 15 , it is an example currently made as [ perform / in the 
upper part of a screen / setting out 32 of zoom ]. 

[0225]Here, what set up the maximum and the minimum of the focal distance by lens setting 
out is displayed. 

[0226]lf the rate of a zoom ratio is changed, it may be expanded and displayed to the center, 
but he uses a mouse etc. for the object 31 to double a focus with first, and is trying to specify it 
as it by drawing 15 here so that a field angle to see in the whole can be specified. 
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[0227]A focal position is decided by this using the distance of an objective specification pixel 
(or average value of some pixels). 

[0228]Then, the outer frame 40 which suited that field angle appears by raising zoom 
magnifying power, it is made as [ display / an attention field angle ], and the focal position is 
made as [ appear / on the volume 29 ] in this example. 

[0229]Since expression including a dotage state will be decided if F value 28, the zoom 32, 
and the focal position 29 are decided, an image is processible. 

[0230]With a center position, the field 30 divided automatically appears and a processing 
condition understands this. 

[0231]Here, 33 is enlarging buttons, 34 is a whole button, by operation of the enlarging buttons 
33, the outer frame 40 whole appears on a screen, and the state of zoom can be known. 
[0232]lt is processible by seeing the whole expansion and zoom front by operation of the 
whole button 34. 

[0233]Thus, if setting out is completed, calculation of all the pixels will be started, a result will 
be displayed by operation of the complete button which is not illustrated, and printing and the 
memory to the memory storage 9 will be made by it if needed. 
[0234](A 4th embodiment) Drawing 16 shows a 4th embodiment. 

[0235]Although the fundamental concept and constitution method of this 4th embodiment are 
the same as that of a 1st embodiment, he is trying to set up the characteristic of a coma 
aberration in this embodiment in the case of setting out of a lens characteristic. 
[0236](a) of drawing 16 shows the characteristic and the mode of expression of a coma 
aberration, and 35 shows the characteristic of the coma aberration. 

[0237]Here, although the coma aberration expresses distortion of the shape of radiation of an 
image when an image separates from the center of a lens, it expresses the aberration in the 
distance r which is separated from the center. 

[0238]That aberration is expressed with the parabola which used the main position (interested 
pixel) as the focus in order to express the state where it is radiately extended toward outside 
from the center, and is radiately extended from the center like 35 as this embodiment. 
[0239]This is expressed with the quadratic curve to this rv, when a line is drawn at the center 
of a screen from that pixel, that normal line direction is set to r and it makes it rv 
perpendicularly, but it is approximated with a function which is closed in the distance d in the rv 
direction. 

[0240]Here, although it is the circle of confusion 36 which is simplified more and makes d a 
radius as other examples and the method of giving the dotage function as astigmatic is the 
same as (a) of drawing 16 , as shown in (b) of drawing 16 , only ro has the ** methods from an 
interested pixel in the center of the circle of confusion 36. 

[0241 ]ln this case, although it may be made to give ro by default, it may enable it to set up by 
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the user side. 

[0242]lt is a function of r, it is a linear function of r fundamentally, and this ro is so large that it 
goes outside. 

[0243]This coma aberration becomes the image that the circumference of a screen flows 
toward the circumference. 

[0244]Generally, although a lens is designed reduce this coma aberration, since it is close to 
the feeling seen by human being's eye, the image expressions of very high quality are possible 
by attaching a coma aberration virtually like this embodiment. 

[0245]Like [ if the circumference of an image is obscured, it is not only, and ] this embodiment, 
depth information is considered and the very natural image expressions near human being's 
visual sensation become possible with the combination of the depth, dotage, and other 
aberration. 

[0246]ln this embodiment, the variable r of PSF is changing in the range of size d of a circle of 
confusion. 

[0247] However, the necessity of changing within the limits of d does not have the variable r, 
and in short, by a big circle of confusion, by a small circle of confusion, the range which the 
variable r of PSF can take also corresponds, it becomes large, and the range which the 
variable r can take corresponds, and should just not necessarily become narrow. 
[0248](A 5th embodiment) Drawing 17 shows a 5th embodiment. 

[0249]Although the fundamental concept and constitution method of this 5th embodiment are 
the same as that of a 1st embodiment, he is trying to set up the characteristic of a chromatic 
aberration in this embodiment in the case of setting out of a lens characteristic. 
[0250] Drawing 17 shows the characteristic and the mode of expression of a chromatic 
aberration, and (a) of drawing 17 shows the size of the dotage function decided by the radius d 
of the circle of confusion 37 as the example. 

[0251]Although 38 is an inner circle, among these the color inside the circle 38 is the main 
pixel itself, external d-delta emphasizes red in the example of (b) of blue and drawing 17 in the 
example of (a) of drawing 17 . 

[0252]Redness requires the circumference of a screen or this chromatic aberration becomes 
the image which required blueness. 

[0253]Generally, although a lens is designed reduce this chromatic aberration, since it is close 
to the feeling seen by human being's eye, the image expressions of very high quality are 
possible by attaching a chromatic aberration virtually by this embodiment. 
[0254]lf the circumference of an image is obscured, there is only nothing, and in this 
embodiment, depth information is considered and the very natural image expressions near 
human being's visual sensation become possible with the combination of the depth, dotage, 
and other aberration. 
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[0255](A 6th embodiment) Drawing 18 shows a 6th embodiment. 

[0256]Although the fundamental concept and constitution method of this 6th embodiment are 

the same as that of a 1st embodiment, he is trying to set up the characteristic of the 

chromatism in the atmosphere in the case of setting out of a lens characteristic. 

[0257] If atmospheric chromatism is original, it is not the characteristic of a lens, but it can direct 

the completely same effect by setting up as the characteristic of a lens. 

[0258]Here, when an atmospheric state completely changes with time and places, for example, 

it goes to the mountain of fine weather, etc., there are many ultraviolet rays and, as for a 

distant place, blueness looks strongly. 

[0259]Many polarization components may be included depending on the direction of the sun 
and **** of a lens. 

[0260]On the other hand, near a horizon or the horizon, when redness comes out strongly by 
the dispersion property of the dust in the atmosphere, it becomes an image of evening glow or 
a morning glow. 

[0261] Drawing 18 shows the atmospheric characteristic and mode of expression of 

chromatism, and (a) of drawi n g 18 is an example of a red shift. 

[0262]lt emphasizes a red field, in being more than the depth with distance. 

[0263]Here, although he is trying to set up the threshold Zth of Z, the method of increasing a 

red shift amount with the size of Z gradually may be used. 

[0264](b) of drawing 18 is an example of a blue shift. 

[0265]lt emphasizes a blue field, in being more than the depth with distance. 

[0266]Here, although he is trying to set up the threshold Zth of Z, the method of increasing a 

blue shift amount with the size of Z gradually may be used. 

[0267]By this, natural depth perception can be later added by this embodiment. 

[0268]Generally, although it improves more than appearance and scenery photographs photo 

distant contrast and color using a polarizing filter in many cases, as for the distant image, 

quality has deteriorated actually. 

[0269]According to this embodiment, an image is easily improvable with simulations, such as a 
fine day, a cloudy day, and the evening. 

[0270]By incorporating a depth direction especially, a natural expression is possible and he 
can enjoy himself with combination with other dotage states. 
[0271 ](A 7th embodiment) Drawing 19 shows a 7th embodiment. 

[0272]Although the fundamental concept and constitution method of this 7th embodiment are 
the same as that of a 1st embodiment, they show other embodiments of a data input means. 
[0273]Although it presupposed input data that it has depth information per pixel in a 1st 
embodiment, At present, both the depth and a picture can be taken correctly and at high speed 
like the usual camera, and it is not so easy to constitute a cheap camera, and it is expensive or 
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requires time for acquisition. 

[0274]Generally, the active method and the passive method are used for data input. 
[0275]The active methods are the interference measurement by laser, an optical cutting 
method, a moire method, etc., and since they are the methods of hitting and measuring light 
etc. on an object positively, measurement becomes large-scale or they require time for taking 
together with picture information. 

[0276]The passive method is the method of measuring using the picture included in a camera, 
and there are stereo **, watching with many eyes, a phase contrast method, etc. 
[0277]As a camera, although the direction of the passive method is an ideal, there is a problem 
of the accuracy of measurement not falling, in being dark, or distance not being uniquely 
decided depending on an image. 

[0278](a) of drawing 19 is one embodiment of a 7th embodiment. 

[0279]Here, it may not be the depth information of a pixel unit and may be a case where the 
distance information of a certain object unit is inputted, and a pixel unit may be sufficient as the 
depth and a certain settled area unit may be sufficient as it. 

[0280]in this case, an object near [ although it divides into the person 10, the tree 1 1 , and the 
mountain 12 and he is trying to have depth information, respectively ] when measuring by the 
active method - a distant object and background may be photoed comparatively 
independently and the distance information of an object unit may be inputted -- it may carry out 
and the method of measurement may change with objects. 

[0281]Also in the case of the passive method, it is the same, but when only by stereo matching 
per object, and judging an object from two or more physical quantity, such as a color and a 
texture, it is a preparation means of important data. 
[0282](b) of drawing 19 is the example simplified more. 

[0283]ln this case, the depth information of - ** is assigned in a certain settled object unit like 
animation. 

[0284]this example - the person 10, the trees 11, the mountain 12, and the empty 39 ~ 
respectively - as tabular - Z1 , Z2, Z3, Z4, and ** it has the same information per object like. 
[0285]ln the case where the depth is measured with the metering device simplified 
dramatically, and the case of the two or more on a measurement screen, this is applied. 
[0286]The measurement can apply the software which performs this embodiment by adding 
depth information later, also when carrying out segmentation of the object only by logging 
which met the intention of a shade, a color, or a user in the two-dimensional picture without 
carrying out. 

[0287]ln this case, logging of a screen and setting out of the depth of an object unit may be 
included in the software which performs this embodiment. 

[0288]And the invention as shown as the following additional remarks (1) thru/or (26) in 
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addition to claim 1 shown in the claim thru/or 3 is included in this invention shown by an 
embodiment which was mentioned above. 

[0289]Additional remark (1) It is an image processing device which adds the effect which is 
equivalent to the dotage according to a focusing state to the captured picture supposing the 
characteristic of a virtual image pick-up **** system, The image input means which 
incorporates picture information including the distance information to each portion of a 
photographic subject, A parameter input means to input the parameter which can derive the 
effective diameter and focal distance of the assumed imaging optical system, The focusing 
position setting means which specifies the focusing position of the imaging lens assumed 
[ above-mentioned ], The distance information inputted by the described image input means, 
and the focusing position specified by the above-mentioned focusing position setting means, In 
the range corresponding to the size of the circle of confusion searched for from the parameter 
inputted by the above-mentioned parameter input means by the circle-of-confusion calculating 
means which searches for a circle of confusion, and the above-mentioned circle-of-confusion 
calculating means. An image processing device possessing the dotage state calculating 
means which fades with a unit spread function (PSF) and searches for a state, and the image 
processing means which fades in the picture inputted by the described image input means 
corresponding to the dotage state searched for by the above-mentioned dotage state 
calculating means, and adds an effect. 

[0290]Additional remark (2) The step which is an image processing method which adds the 
dotage effect according to a focusing state to the captured picture supposing the characteristic 
of a virtual imaging optical system, and incorporates picture information including the distance 
information to each portion of a photographic subject, The step which inputs the parameter 
which can derive the effective diameter and focal distance of the assumed imaging optical 
system, The step which specifies the focusing position of the imaging lens assumed [ above- 
mentioned ], and the distance information inputted [ above-mentioned ], An image processing 
method possessing the focusing position specified [ above-mentioned ], the step which 
searches for a dotage state by an operation from the parameter inputted [ above-mentioned ], 
and the step which fades in the picture which inputted [ above-mentioned ] corresponding to 
the dotage state which the account of the upper searched for, and adds an effect. 
[0291]Additional remark (3) The step which is an image processing method which adds the 
effect which is equivalent to the dotage according to a focusing state to the captured picture 
supposing the characteristic of a virtual image pick-up **** system, and incorporates picture 
information including the distance information to each portion of a photographic subject, The 
step which inputs the parameter which can derive the effective diameter and focal distance of 
the assumed imaging optical system, The step which specifies the focusing position of the 
imaging lens assumed [ above-mentioned ], and the distance information inputted [ above- 
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mentioned ], The account of the upper with the focusing position specified [ above-mentioned ] 
and the step which searches for a circle of confusion from the parameter inputted [ above- 
mentioned ] in the range corresponding to the size of the circle of confusion searched for. An 
image processing method possessing the dotage step which fades with a unit spread function 
(PSF) and searches for a state by an operation, and the step which fades in the picture which 
inputted [ above-mentioned ] corresponding to the dotage state which the account of the upper 
searched for, and adds an effect. 

[0292]Additional remark (4) The step which is an image processing method which fades to the 
captured picture and adds an effect, and incorporates picture information including the 
distance information to each portion of a photographic subject, An image processing method 
providing in order the step which adds the dotage effect by overwrite from the portion of the 
picture which has distant distance information in the picture which inputted [ above- 
mentioned ]. 

[0293]The characteristic of a virtual imaging optical system is assumed in an additional remark 
(5) image processing device, It is a recording medium of the computer readable program 
recorded in order to add the dotage effect according to a focusing state to the captured picture, 
The 1st computer readable program means that brings the function to incorporate picture 
information including the distance information to each portion of a photographic subject to a 
computer, The 2nd computer readable program means that brings the function to input the 
parameter which can derive the effective diameter and focal distance of the assumed imaging 
optical system to a computer, The 3rd computer readable program means that brings the 
function to specify the focusing position of the imaging lens assumed [ above-mentioned ] to a 
computer, The distance information inputted [ above-mentioned ], the focusing position 
specified [ above-mentioned ], and the 4th computer readable program means that brings the 
function to search for a dotage state by an operation to a computer, from the parameter 
inputted [ above-mentioned ], A recording medium, wherein the 5th computer readable 
program means that brings the function to fade in the picture which inputted [ above- 
mentioned ] corresponding to the dotage state which the account of the upper searched for, 
and to add an effect to a computer, and ** are recorded. 

[0294]ln an additional remark (6) image processing device, the characteristic of a virtual image 
pick-up **** system is assumed, It is a recording medium of the computer readable program 
recorded in order to add the effect which is equivalent to the dotage according to a focusing 
state to the captured picture, The 1st computer readable program means that brings the 
function to incorporate picture information including the distance information to each portion of 
a photographic subject to a computer, The 2nd computer readable program means that brings 
the function to input the parameter which can derive the effective diameter and focal distance 
of the assumed imaging optical system to a computer, The 3rd computer readable program 
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means that brings the function to specify the focusing position of the imaging lens assumed 
[ above-mentioned ] to a computer, The distance information inputted [ above-mentioned ], the 
focusing position specified [ above-mentioned ], and the 4th computer readable program 
means that brings the function to search for a circle of confusion to a computer, from the 
parameter inputted [ above-mentioned ], It corresponds to the dotage state as for which the 
account of the upper asked with the 5th computer readable program means that brings the 
function to fade with a unit spread function (PSF) and to search for a state by an operation in 
the range corresponding to the size of the circle of confusion which the account of the upper 
searched for to a computer, A recording medium, wherein the 6th computer readable program 
means that brings the function to fade in the picture which inputted [ above-mentioned ] and to 
add an effect to a computer, and ** are recorded. 

[0295]lt is a recording medium of the computer readable program recorded in order to fade to 
the captured picture in an additional remark (7) image processing device and to add an effect, 
From the portion of the picture which has distant distance information in the picture which 
inputted [ above-mentioned ] the function to incorporate picture information including the 
distance information to each portion of a photographic subject, with the 1st computer readable 
program means brought to a computer, in order by overwrite. A recording medium, wherein the 
2nd computer readable program means that brings the function which adds the dotage effect 
to a computer, and ** are recorded. 

[0296]A means to input image data including additional remark (8) depth information, and a 
means to set the parameter expressing the characteristic of a lens, A focal distance, an F 
value, a field angle, and a means to set up any of the effective radii they are, An image 
processing device with a means to calculate expression for the textures of a picture including 
dotage from a means to set up the distance with which a focus is doubled, the preset value of 
these virtual cameras, and the depth information of a picture, and a means to memorize this 
calculation result to an image memory. 

[0297]a means to input the picture which has depth information in each pixel unit of the picture 
of a two-dimensional additional remark (9) - composition - the image processing device given 
in an additional remark (8) characterized by things. 

[0298](Corresponding embodiment of the invention) It is shown in a 1st embodiment. 
[0299](An operation and an effect) Only the image data which incorporated the depth 
information a photograph of was taken on the spot is inputted, and the rest is only the 
information on the set-up lens, and a position of a focus to double, and can constitute a virtual 
camera. 

[0300]This virtual camera becomes possible by setting up change of a photographing 
condition, and the characteristic of a lens about the state of a natural cubic effect, or dotage 
and textures. 
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[0301 ]An image processing device given in an additional remark (8), wherein an additional 
remark (10) dotage function is a unit spread function (PSF) calculated in a pixel unit from the 
focal distance of a lens, an F value or a caliber, the distance with which a focus is doubled, 
and the depth information of a picture. 

[0302]An image processing device given in an additional remark (8), wherein a function form is 
variable and an additional remark (11) dotage function is a concave function determined with a 
focal position and the distance of the object to calculate, or a convex function. 
[0303](Corresponding embodiment of the invention) It is shown in a 1st embodiment. 
[0304](An operation and an effect) Only the image data which incorporated the depth 
information a photograph of was taken on the spot is inputted, and the rest is only the 
information on the set-up lens, and a position of a focus to double, and can constitute a virtual 
camera. 

[0305]This virtual camera becomes possible by setting up change of a photographing 
condition, and the characteristic of a lens about ideal textures and artificial textures while 
expressing the state of a natural cubic effect, or dotage and textures. 

[0306]By displaying the calculation result using the coarse picture which the additional remark 
(12) user changed freely the position of the focus specified by an F value and YU 1 THE by 
volume, and thinned out the picture which carried out human power, An image processing 
device given [ with the parameter setting which can be checked by interactive mode ] in an 
additional remark (8). 

[0307](Corresponding embodiment of the invention) It is shown in a 1st embodiment. 
[0308](An operation and an effect) Only the image data which incorporated the depth 
information a photograph of was taken on the spot is inputted, and the rest is only the 
information on the set-up lens, and a position of a focus to double, and can constitute a virtual 
camera. 

[0309]This virtual camera becomes possible [ setting up distance to double a focus with by 
interactive mode, looking at a certain amount of result ]. 

[0310]An image processing device the additional remark (8) determining a focal position using 
the depth information of the screen because an additional remark (13) user specifies the 
position of a screen, and given in (12). 

[0311]Specifying the position of the focus on the screen specified by an additional remark (14) 
user. An image processing device the additional remark (8) having the parameter setting which 
can check the position of a focus, and specification of an F value by interactive mode by 
displaying the calculation result using the coarse picture which changed the F value freely by 
volume and thinned out the inputted picture, and given in (13). 

[0312]An image processing device given in an additional remark (8), wherein an additional 
remark (15) user changes zoom magnifying power by change of f value. 
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[0313]When setting up additional remark (16) zoom magnifying power, first The central point of 
zoom, An image processing device given in an additional remark (8) setting up the place with 
which a focus is doubled, and calculating a dotage state with the expansion on a screen using 
the center coordinates and the depth information of a point of zoom, or determining a 
parameter by interactive mode. 

[0314](Corresponding embodiment of the invention) It is shown in a 2nd embodiment. 
[0315](An operation and an effect) Only the image data which incorporated the depth 
information a photograph of was taken on the spot is inputted, and the rest is only the 
information on the set-up lens, and a position of a focus to double, and can constitute a virtual 
camera. 

[0316]lt is only setting up a place to double a focus with, and this virtual camera doubles a 
focus with that position, and it becomes possible to set up other cubic effect and textures by 
interactive mode, looking at the result of certain extent. 

[0317]An image processing device given in an additional remark (16) when setting up 
additional remark (17) zoom magnifying power, wherein display magnification displays the 
outer frame of the field by which the enlarged display will be carried out without changing. 
[0318]Based on the center coordinates of the zoom specified by an additional remark (18) 
user, expand a screen and the position of the focus on a screen is specified, By deciding the 
position of a focus and displaying the calculation result using the coarse picture which thinned 
out the picture which changed the F value freely and inputted it by volume, An image 
processing device given [ with the parameter setting which can check the center position of a 
field angle, and specification of zoom magnifying power and an F value by interactive mode ] in 
an additional remark (8). 

[0319](Corresponding embodiment of the invention) It is shown in a 3rd embodiment. 
[0320](An operation and an effect) Only the image data which incorporated the depth 
information a photograph of was taken on the spot is inputted, and the rest is only the 
information on the set-up lens, and a position of a ********** focus, and can constitute a virtual 
camera. 

[0321]This virtual camera sets up a place to double a focus with, and it is only setting up zoom 
magnifying power, it doubles a focus with that position, zooming of it is possible, and it 
becomes possible to set up other cubic effect and textures by interactive mode, looking at a 
certain amount of result. 

[0322](Additional remark 19) Image processing device given in an additional remark (8) taking 
in the influence of a coma aberration which changes with the distance and the directions from 
the center of a picture, and expressing a dotage state. 

[0323](Additional remark 20) Image processing device the additional remark (8) characterized 
by asking for an unsymmetrical point spread function by the dotage function which shifted the 
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center position of the radius of a circle of confusion according to the distance from the center 
position of a picture for the coma aberration, and given in (19). 
[0324](Corresponding embodiment of the invention) It is shown in a 4th embodiment. 
[0325](An operation and an effect) Only the image data which incorporated the depth 
information a photograph of was taken on the spot is inputted, and the rest is only the 
information on the set-up lens, and a position of a focus to double, and can constitute a virtual 
camera. 

[0326]lt becomes possible [ this virtual camera ] to take in the influence of a coma aberration, 
and the textures of the picture similar to human being's eye have the feature acquired by a 
virtual camera. 

[0327](Additional remark 21) Image processing device given in an additional remark (8) taking 
in the influence of ********. 

[0328](Additional remark 22) Image processing device the additional remark (8) considering a 
certain range d-delta as the chromatic aberration region of influence from d among the 
symmetrical point spread functions of the radius of d, and incorporating red aberration or blue 
aberration, and given in (21). 

[0329](Corresponding embodiment of the invention) It is shown in a 5th embodiment. 
[0330](An operation and an effect) Only the image data which incorporated the depth 
information a photograph of was taken on the spot is inputted, and the rest is only the 
information on the set-up lens, and a position of a focus to double, and can constitute a virtual 
camera. 

[0331]This virtual camera becomes possible [ taking in the influence of a chromatic 
aberration ], and a periphery is tinged with red or it has the feature from which the textures of a 
picture with the feeling of human being who is tinged with blue are obtained by a virtual 
camera. 

[0332](Additional remark 23) Image processing device given in an additional remark (8) taking 
in the influence of a shift of the color in the atmosphere. 

[0333](Additional remark 24) Image processing device the additional remark (8) emphasizing 
blue areas or a red region for the color characteristic beyond a certain distance, or attenuating 
a red region or blue areas, and given in (23). 

[0334](Corresponding embodiment of the invention) It is shown in a 6th embodiment. 
[0335](An operation and an effect) Only the image data which incorporated the depth 
information a photograph of was taken on the spot is inputted, and the rest is only the 
information on the set-up lens, and a position of a focus to double, and can constitute a virtual 
camera. 

[0336]This virtual camera becomes possible [ taking in the influence of the chromatism in the 
atmosphere ], and has the feature from which the textures of a picture with the feeling of a 
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nature that a distant place is tinged with blue, or the neighborhood of a horizon is tinged with 
red are obtained by a virtual camera. 

[0337](Additional remark 25) Image processing device given in an additional remark (8) 
characterized for a means to input each pixel, or the depth information and picture information 
in an area unit as ** and pine ****** by **** in each object unit. 

[0338](Additional remark 26) Image processing device given in an additional remark (8) being 
a set of the object in which an inputted image is not a pixel unit and had a fixed distance by a 
certain settled object unit. 

[0339](Corresponding embodiment of the invention) It is shown in a 7th embodiment. 
[0340](An operation and an effect) Only the image data which incorporated the depth 
information a photograph of was taken on the spot is inputted, and the rest is only the 
information on the set-up lens, and a position of a focus to double, and can constitute a virtual 
camera. 

[0341] Processing of this invention is given to the picture of the picture which processed the 
input to this virtual camera using the usual two-dimensional picture, and was produced, the 
three-dimensional measurement picture acquired in simple and the picture acquired by 3D 
authoring tool, an animation picture, etc. 
[0342] 

[Effect of the lnvention]According to the invention according to claim 1 , the inputted portion of a 
request of a picture can be made into a focusing state, and dotage of the request 
corresponding to distance can be added to other portions. 

[0343]A picture which is focusing by this on all the screens that were photoed with the compact 
camera, for example is also processible into the picture which employed efficiently the feeling 
of dotage which was photoed with the high-class single-lens reflex camera. 
[0344]Since the virtual optical system is assumed, dotage is not unnatural, either. 
[0345]Since a focusing position can be specified freely, a distant view can be obscured or ** 
which was able to obscure the close-range view is made free. 
[0346]arbitrary virtual optical systems - ****** reappearance can be carried out. 
[0347]According to the invention according to claim 2, the problem of the "fogging" in the 
processing which adds dotage is solvable. 

[0348]According to the invention according to claim 3, since it can shift to the processing which 
adds dotage to the whole screen after checking the effect of dotage in some screens, it is 
efficient. 

[0349]Therefore, by according to this invention, solving conventional SUBJECT and enabling 
utilization of the improvement in textures of the digital camera as a virtual camera, as 
explained above, The image processing device which can contribute textures, such as dotage, 
to realization of the digital camera system which can be added effectively can be provided. 
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* NOTICES * 

JPO and INPIT are not responsible for any 
damages caused by the use of this translation. 

IThis document has been translated by computer. So the translation may not reflect the 
original precisely. 

2.**** shows the word which can not be translated. 
3.ln the drawings, any words are not translated. 



DESCRIPTION OF DRAWINGS 



[Brief Description of the Drawings] 

IPm^g_l]p^ng_lis a functional block diagram showing the composition of the basic 
technique of this invention. 

^mmLmm^^s a figure showing the image formation state of the object before the 
focal position of a lens. 

JBSBtDOm of dmwing.3 is a figure actually calculating the relation of (5) types and in which 
quan„fy,ng and showing it, and (b, of drawing^ is a figure graph-izing the calculation result of 
(5) types and in which showing it. 

IDrawM4](a) of drawn^s a figure actually calculating the relation of (8) types and in which 
quanwymg and showing I,, and (b) of draw^A is a figure graph-izing fine calculation result of 
(8) types and in which showing it. 

IDllwip^^ a figure showing the image formation relation of the object which is far 

away rather than the focal position of a lens. 

^mmam^s a figure showing signs that it appears as a state of actual dotage after 
(a) of aYa^ng_3, (b), and (a) of o^wing 4_and (b) have combined 

I2»]Pl^shows the explanatory view of the PSF characteristic, and (a) of drawmg 

— PSF ,n tne Zf o side in the case of being nearer than Zf. 

l^drawjng_7j S PSF which a distant image makes rather than Zf. 

l^amrmmi:^ a flow chart which shows the procedure of the actual processing by a 
1st embodiment of this invention. 

[P^g^pxawing_9_is a flow chart which shows the procedure as an example in the case of 
calculate the conversion process of the actual picture of the step (S5) of drawing 8 per pixel 
JDjlwingjIOl- of SUBJECT to which (a) of drawing 10 is left behind by 1st embodiment of this' 
invention - carrying out suddenly, it is the "fogging" between the objects by the turn of the 
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shown processing, and (b) of drawing 10 shows the means of solution of this "fogging", and (c) 
of drawing 10 shows other solving means. 

[Drawing 11] lt is the figure shown in order that drawing 13 may explain the concrete 
processing in a 1st embodiment from drawing 1 1 . 

(a) of drawing 11 is a figure which illustrates the screen which sets up the characteristic of a 
lens first, and (b) of drawing 11 is a screen which sets up aberration, and (c) of drawing 1 1 , It 
is a figure showing the function to set up the form of a dotage function (Point Spread Function), 
i.e., the unit spread function within a circle of confusion. 

[Drawing 12]Drawing 12 is a figure showing the parameter setting (Step S3) of the virtual 
camera shown in drawing 8, and focal position setting out (step S4). 

[Drawing 13]Drawing 13 is a figure which illustrates the last image acquired with the parameter 
determined eventually. 

[Drawing 14]Drawing 14 is a figure showing a 2nd embodiment. 
[Drawing 15]Drawing 15 is a figure showing a 3rd embodiment. 
[Drawing 16]Drawing 16 is a figure showing a 4th embodiment. 

(a) of drawing 16 is a figure showing the characteristic of a coma aberration, and an example 
of a mode of expression, and (b) of drawing 16 is a figure showing the example simplified as 
other examples. 

[Drawing 17]Drawing 17 is a figure showing a 5th embodiment. 

(a) of drawing 17 is a figure showing the size of the dotage function decided by the radius d of 
the circle of confusion 37 as an example which emphasizes blue, and (b) of drawing 17 is a 
figure showing the example which emphasizes red. 

[Drawing 18]Drawing 18 shows the atmospheric characteristic and mode of expression of 
chromatism as a 6th embodiment, and (a) of drawing 18 is an example of a red shift. 

(b) of drawing 18 is an example of a blue shift. 

[Drawing 19]Drawing 19 is a figure showing a 7th embodiment. 

(a) of drawing 19 is not the depth information of a pixel unit as an example, are the distance 
information of a certain object unit a case where it inputs, and (b) of drawing 19 , It is an 
example which assigns the depth information of - ** in the settled object unit which has been 
made into the example furthermore simplified, and is a case where it is made as [ have / per 
object / the same information ]. 

[Description of Notations] 
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1 - Input output processing section, 

2 - Image input means (three-dimensional (D) measurement data input part), 

3 - Parameter input means (virtual camera set part), 

4 -- Set part of textures or a lens, 

5 - Focusing position setting means (virtual focus set part), 

6 -- Image memory 

7 -- Virtual camera parameter transform calculation part, 

8 - A circle-of-confusion calculating means, a dotage state calculating means, image 
processing means (picture calculation part), 

9 - Picture (record) memory storage. 



[Translation done.] 
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* NOTICES * 

JPO and INPIT are not responsible for any 
damages caused by the use of this translation. 

1 This document has been translated by computer. So the translation may not reflect the 
original precisely. 

2.**** shows the word which can not be translated. 
3. In the drawings, any words are not translated. 



DRAWINGS 



[Drawing 1] 
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[Drawing 2] 




[Drawing 3] 
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[Drawing 4] 
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[ Drawing 5] 
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W»14ff->!t«:»tt4tft r *>-lf) J X-&&. 
[0 1 563 Mioco (b) (i. r^jthj <ofi|^ 

[0 1 57 3 ■f'Srfcfe. 01OO (b) t^t±3C. 

(rc&it«w&-atHS3RSffiDni- * £ t x-h i> . 

[01 58 3 CO^tti, «S3& f J: , 3»^*12*» 

[01591 z ix. zcotz-k. mrv&amfciMz* 
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[0160] • 5SvMW*l Ofctyhj8**->Tt*v^* 
*«1Wk«>B!»7ttJBiraM\ ifiaffit&JflfflfiJ 
S-SiSSHfcl/C. *?<ot^-fc;WojS*wfeffi«{c«rl 

[0 1 6 1 ] HI 0« ( c ) ti, ffi4J8&#&£5SLT 
US. 

[01 6 2]?febfe. 1311 00(c) (CqftM:)<C. 
[01633 COMTii. dJOtWfcl 2Vfich&%<0t 

[0 164) <5fi^!|lffel0Ht>'b*^-7TV^V^i 

[ 0 1 6 5 ] OJ; dflrfffilj&MftHFC**. 
[01663011 £> 0 1 3 tiu 51 1 05S6fc4$J5C 

0T*&*. 

[0167] Zixte. %S£<7)3yV A -?0>m&XW4 
10 1 68] 01 1*4. SSBfcU^oettSrKSr* 
[0 169] i/yXwfflWi, S>^t«>T7a-;uME 

[0 1 703 ^iOPK'ii. U^X. JR2£, arttlJWW>3 

[01 71 3 01 lO (a) li. IryttftStriWifi 
13T2b&. 

[oi 723 ii\ i^xtfiMi 6*\ 

[0 1733 *LT, 4«lu£i'VX&affiUfcS*C 
li, ffS18SWi4fc«fc, X-A*SJRLfc*S^C 
Ji. MaxtMi n-50fli$:Ait^*<s CLilttSfcTt'A. 

[0 174]»t, ^>XOPgl92r(5]«lLTAit 
5. 

[ 0 1 7 5 3 0 1 1 <0 ( b ) ti, Jjft££^itf S®fi5T 
[0 1763 ifSmo?t r 2QZ7V</7tZ>Zk 
[0 177) wdTli, #j#R22 1 . rj-7JR2!2 2 , 



[0 1 7 8 3 ifc. 3^JR^&*©4^-Ww>BK 

[0 1793 d(yA-A*$ffi->"C«>AV» 
ttttMJIl 2441*5' VCJ:>K 7 ^ ^-094*11 

[01803 witr. -«u7*^9««j*ttt, ao 

1 0 1 8 1 3 t4J:4&Mft*. 2b^A»fe^--f-gJ3' 

[01823 £*tfHDafcoR»cwr tt, &StOx9* 
£ WBStfl /bfL* <fc 5 fcrfr* £ 1 1» r & 5 . 

[01833 Witf. #£HX£fc 3-?fK££j$!KHr. * 
tibem&tfmttiiX fc*4 Z 1 1 S . 

[0 184 3 iiVti, ^viR^i, lft£L*:JB|-?tfW 

5 * - * S a— 9'- 8 fl-etS&gf 6 £ fe itt § 5 J: -) 

[0 1853 01 ltfXcXi. ffitUHL ?**>*>. 
WMM^mtPo i nt Spread 

Function) OJiJS'iSJg-f&ffiSB&^L'Ci* 
4. 

[0 1863 zzz-ii. mmwMm&oiSfecDK. 

[0 1873 ££f(i. jKLftW^affigJ: 0 tffiv^tt 
S:j™2 6i:LT, av«tt*jSI«»2 7 t tTSL 

[01883 WJIftJgOlEt LTli, J&raXttQgn&T' 
■tx&flWABJc 0 *)/Jn3 1MB, SREKdanft^ UT+ 

[0189JCCC. 3^A^* { ^^6«S§LPq4 

[01903 ftj&waajfc-^vctt, ja^swxTtA 

IB3KU, H5 »^-ffttfg*t3Si^*i* J: 3CtS. 

[0191] fit. mmwrnt-m^tchi. 
[ o 1 9 2 j 5a»otf«±oiwat . sii^rasc 

[0193] BBWB^ItDSClffii A 3fc1-6fcftK. 
G(r)TtfiOL. G (r)/r-Cfca^U G 
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<r) /r J "Cfcfin. 

[01 943 01 2 li. ESCwLfclfc&W^OA? 
S4) Sr5rT. 

[01953 ffiBHtt^-— f-tcttv^s«o 

[01961 2.^-9*— ti, Ffi2 8 fcfc&O) 
fflE295. £©«r«4#yj«.*-A (28. 29) Sffl 

art- s c t fc i o . ww* i fctfr* & . 
[0197] «itf . mtttfrSMWLfcvwe&fctf. 

P«**8<1. 4C-T6. 

[ o 1 9 s ] iwttiasaw-* t „ was Lfc f tt& 

(8) *«OT8ft&. 

[019 9] lit, 01 2te*Lfc«flU4, ®t-l% 
[0200] wiO^-^-fficOllSfc LT£tr?-te/W5: 

[0201] Mttf „ l!!fct!fc#VGA04 80 X 64 0<7D 

aaictt. ih.fr 1/5 tiagivi-cs 6xi 28fc+s 

iCOWflSr. Witf , 4#85 < 3 0 ) 
[02 02] £«>44HH®3*. «4tf. g52t^43K 

xttwiRftfraj-ridicts. 

[0203] £Oil3WBrCJMltf . AT" 

mv% v FiS'WtuisottSE-caftfraiawi ^ t *<x 

[0 2 0 4] ^coffi8Jj*7li. FMPWkjftfrSQRO^ 
[0205] CLh«>J:3CLT» RjfcWLfcfe. 12 

a>a ^awBfcr. owpwhssib 

9^(7>£ts* { fc8fi&. 

[02061 01 3W. C3L-C«8»fcJtt!U:A9 

* - ? £ i O Tft *,<lfcfifttttt«OWfr * LT Ir ^ . 

[0207] :<0i')t, tyhfrfcb*fcA*10i± 

[0 2 0 8] I^(3f(tWi, ffliaUiJ; 5tc, 
romtBMlWSBfr & i 4 - k Tfi *C33E*rfiST'& 4 1 

[0209] io*s^. fc&ww-rfcwyx-ei*, 

(0210]£>t. nvfR^frAh-St. ffiiU.M<7)V>M 



ro2ii] wc, ajssfci-jT^sftjH^ wg& 

Sit J; ■TC£fb?&<9T\ «M>T UlTOjS . 
[0 2 1 2] fi4Hfc& ffltCi-j-CKUS^fc 

[0 213] (3&2«Safi<WB!®) 014(i. £2t0f? 
tfi<0?BJSfr^L-C 

[0214] iwg52 Wsl^<^iaS3W^im > l«lS 

*sai. *i«^t?»Bffi^-c**. 

[ 0 2 1 5 ] 01 4(i, ffittlfcBIl 2Wtthvffli&> 
[0216] idT. BiwSWWSWBTMi. ftjftratt 

[0217] doerctt. FgBiJif y a-Ata®f s 

**. t>M4A»310B(te:*b*4J:3fcLT**. 
[0 2181 »att&4SR*tiffllfr it& LT z 

[021914*. tt***¥ttTtt, *<08mt»* 
<or. JSJ£ L^yftwaWWJraifrJpaW"* «t 5 fc LT €> 

[02203 i^idtLT. aSJ#SeTLte4, 0^ 
0, ig'KfySt-C, EpfK>lat^ig9 

[022 1] (ff3^aK»8B) Bl 5tt. «3«SH 
[0222] i^30^tfe^!B^£4^K^^ 

r^si±, i ^6<we©i Etraa . 

[ 0 2 2 3 ] 01 514. X-mm&^WSrfrc?>2-- 
iM ^-7s-^frSS^U*3lite<^JBT*fc5. 

[ o 2 2 4 1 c cx% m i «Maitfwear«±, x-a 3 

01 5««*ttt. SB«JhffCX-A«||ia63 2*f 
[02251 CCf. ^SEfitO^At^Jskti. 
[ 0 2 2 6 3 CCT. X-AttJpfrSEi* fc . 

***!:V4rtk3 lfc-?>>^frfflv^lSSt&J:a(c 
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[0227] ZtiX\ WtW9tiit:9-t}l> < 4fett«r? 

to2 2S3 *<m.* 

[0229] ifc. F[fi2SiX-A3 2, &6ffiig£2 

[0230] £;ft<i, <K<fiMfc J: mm^m* 

[023 1]wvI-C. 3 3fcH£*#*y. 34ii£fctf 
VVZ'h*}. i£±^^3 30S(mJ:oT. fl#4 0 

S. 

[0 2 32] jfcfc* &tt*?V340)£ft5tcJ:o-C, fit 
*. 

[0233] COi^fcL/C. StofcWS57U:6w 0* 

tt)w*K3iu jfiSBcjtrfct, mmmm. 
[0234] {%4<7y$m?>Tm) m 6«, mm 

[0235] i«354<0^^®O3^'irfif^H» 

j£#aai, as i vRmcomm t ®m-$> t> *\ comm 
mzbx^hi>e>vs>l. 

[0236] 121 6co U) fct zvMwM&km 
*. 

[ 0 2 3 7 ] £ it, 3*?J|X3lfcJ:, flb^UyXO*^** 
[0238] *WR2«*. WA'&^fcfflA'oTftWlK 

[02 39] wil(i, *^e?^;!p£ilHo^'l>£& 

SEStdTfT^a <fc 5 OTSCT«f * . 
[0240] [fiTOfllfcl/Ctt. ±9ffltfkL 

T. d*i|iffik-r&»fiLR3 6Tft»]. ifivSiKSfc LT 
«eWBKfe*£4*8ttHl 60 ( a ) fcp] fcfti 
Bl&O (b) oJ:3t. ^San3 6<O^C> 

[0241] ro{iT7*;UNT4x4J:'; 



[ 0 2 4 2 } r o r wKI&T'ifc 0 . Stttitti 

[02431 ^^aviRgji, mRMssntfmmztofr 

[0244] HRfc. l">Xli, Z.<OZT7tm^mit 
[0 24 5] Wfc. M^JW^B^tOTtdJl 
[0246] ;«Sai5«»3BC45v»T<±, Ig&FJ 

was § doaarcp s Fvm. r asefctt 5, 

[0247] L*>U #&-fLi>> S»rttd«JBHrt , C 

[0243] <ft5a&tta»®)Bl7<i>8I5a% 
[ 0 2 4 9 ] £ e>35 5 0>ISte^®W3S^*&is'W8 

fftjm&iimi&n&Btmx'h&v. zcvmv 

T4 LX^Z> h WXhi . 
[ 0 2 5 0 ] m 1 7(4. «lR&04refc&lti&£ftf > 
fc^T, 01 70 ( a ) i±, ^-O-piJk UT. 5JtS.P53 

7 co^a d s towmnk & S *S? U t . 

[0 25 1] 3 8ttrtPTTJb-»T. -^>l*in3 8^26 
<0fe(i4"C<t^-t/U-tc5tOT&4*^ ^d -At±@ 
1 7» ( a ) *)Wtfi#fe. Ell 70 ( b ) o»?t4* 

[0252] -TiDfeJR^ti, ®ffic0]3Ba* I #**f*'*»o 

[025 3] HRtC. UVX(i. wWfelR^JffljjS-r^ 

frxmmmmmymx-hz . 

[0254] Jtfc. fllC «»«JSBaS(BW'WC14S 
[025 5] (jB60&ig<&» 01811, 

[0256] ;<o3!6 (ommmmmm&m 
mmt. mn^tmm.'tn'&X'hhtf. ^yz® 
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l±»W. ]s>X0)W£blX%lfetZ>ZbX\ ±<PI 
[ 0 2 5 S ] *>M>ttlWi. HfrfSi'Mi £«£ 

[02 5 9] 4fc. jfcBkl/yXO^Wfc^iiCJ:-* 
[0260] flWtitoMqMSS^i, 

[ 0 2 6 1 ] 12 1 81*. ^O^'iSOlfttt^^ 
S-^-tOT', @18«(a) (±#v7 VtO-^Tft 
I. 

[0262] IEfg£<£&8&£LJba*4fCtt, Jtfefll* 
[0 263] ££T«* ZOlSiSZthSrSftS-r**? 

[0264] 01 S<0 (b) feWi^KO-fl?**. 
[02653 rafeW&4*SJ2l±*)%frfcl±. ftWflW 

[0 2 66] ZZX'lt. Z^HBZth*a*r*J:3 
(Cl/C"*#. aW»CZ«>*&$CJ:->Ttti'71'tt 

[0 2 67] ^il^J:oTs £O&S&0Bfl3Tii. i8& 

[0268] -mz, flSWSfr *tt. fl?*7 < 

[0 2 69] iwSft^WKBttt. WflfcB. 
[0 2 70] ^C. SB$;fj|ii]2:JRD&tfwk-C\ 
[0 2 7 1] (Sg7<023S«S> 01 9tt, 

[02723 z^mKo^comB^m^mm-^m 

[ 0 2 7 3 J 311 «OSHt0»18Ttt. A#T-?i* 
*/MlffiT8&ffiW*»oTV>4£fcl: Lfc#. $P*£ 

[0 2743 HRCtt. ^-^X*«*:ftfc. 7?r-r 



[ 0 2 7 5 3 77r -f T'jfcti. V— f-tc J: 

BflMWB fc -aBWRi izmffltffrtrit: *) 1 
[ 0 2 7 6 3 't» S'T'SHi** 9 fcA^T < 

^T»et&*a , c , jb->T, ^usrttt^Ka, cog 

[ 0 2 7 7 ] U* 7 1 LT(i. A* 7 ^7^#tfa«T 
[0278] 019«O (a) l4W7«SStW«RJB»l-? 

[ o 2 7 9 ] w iTii. e^-t;k^li^§ffiffitliii 

2 jit? * A-JUflrcfc a» u *& & fc n^mm 

X'i>&\ 

[0 280] COJSSttAftlO. #1 1, 0il2fc# 
HU **t#fi«3ffi«*«roJ:3eLT^*a t . T9 
*M7%X'M$tf iff"*** JtWWWfO 

[02si] wi'7&<?)%>&izij®m:'&?>ff, w«c 

mi4T^r l^V v f - y ^waJWUT-* £1 

[0282] 019(0 (b) (i, fcokjBBHtLfcWT* 
[ 0 2 S 3 ] ^J^fcltl. 7-X~is g VtOi -j 

s. 

[02S4] iOfPJTtt. A«ll0» CS*1 1, [ill 
2,£39li, fil'fitWRkLT. Zl. Z2. Z 

[0285] zmt. nxKmfcitifi&tarmz 
tit. 

[0286] IHWiLftV^r, 2»5Eo!)ffi**. 

m*&. tint*— r-<r>mziB-,tzm&ico7t 

V 7 h *7 x r <! t tfVk z> . 
[0287] zm&* MB^JOffitts ft*MLtt«> 

[ 0 2 8 8 3 * L/C . ±»US i 3 >3^iS03K!BT^L 

/s*»wctt. mmxvfcwizKLtMmm.3 
miz. tiT^ttia ( i ) as ( 2 6 > t ixm* o 
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[ o 2 8 9 ] ftie ( i > Em%m%m%covim 
tiw&mt x-n^m^m^^x-mmmn o &tr 

Sft£-afiU2a k . ±22^7 A:fi#&fc J: -j X A 
0L*fcfflT\ Wa/StfWSC (PSF) CiOtlWK 

r o 2 9 o i f*aa ( 2 > 

iw^m-t&mmmii^X'M. wmv&m 
±x'com.im ! Z:'£A,xwt&tii®zm atrxf - ? r 
k, sss^jais^^^^fc^JiaiS:**^ 

t$fcA7*-*£A#-f£*T'y7 , k. .fcESUeSflfc 
Sitfc8g8ffi«fc> ±=att££ft*M^a!£fc, ±EA 

[0291] #12 o) m&mmm%<?mm 
mix, m^mmztiLxi&immiti® 
mzm?zm:zmvtmwmh-mx'h r ) . tt? 

•c. (psf) "jB:wiai*a»t 

lx . ±iex* LfcMftfcor iio * & *r 7 r 

I O 2 9 2 ] fflB ( 4 > 1R OaX^fffiftfcW UT tttt 
JJBA*WiH«fc. ^OKWiTOSfcoBfltofiMi- 

[ o 2 9 3 ] m ( 5 > ffi«aaffl»Efc*ii. vc. flz» 



3R 9 5i <Mfi£ & 3 > t a - * t *> £ 1 <0 3 ^ tT a 

flSft^SEStfflSBk, JhlEli££ft*:£-&ttaik s JJB 
6^£3V*a-*fcfcfcWl4<03>'£; I .- ; 7y 
1 1 . JbEA* Lfc*«fcBrw»*sin;l * SSfigS ^ y 

??j>z®b> ifmiLixx^ztzmti-zm 

1 0 2 9 4 1 fffi ( 6 ) WflHSa»ittfc*JV vc , m 

Wi®mm o struffi^ 3 y tr c 1 1 1 
t at 3 <o 3 v t a- ^ y - y d /9 a#s 

k. iSaA^^itAcffifliffi^t, 

Kk . JUEAasiws/***-* ± •) . tfans«ft* 

WJSLJfeJillT. iiiffiffi^y^ (PSF) tAOWt 
m5<03>t*-^y-^7';l'7 , n^9A^St. ±2£ 

a-yy-^^rD^A^Rfc, *<SE«Jfii'Cv>6 
[0295jftf£(7) mUSRMaB^l^T. KO 

-f'J-ffll'rtJT'J&Z&t , JaSA^LfciJa 
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i o 2 9 6 j tfta < s ) 8&mt zttm&T- ? * 

[02 97] f*32 (9) 2}JC7EOlfffiO*t^-t;Hft 

[0298] (ttOT&&^%ttg»BK>asi«)&B 
[0299] (m-m)3miK%zmm*)& 

[0300] ze>m#* 7\±. ijss4±flcawft» 

*;:fcT*r6ijfc&6. 

[ 0 3 0 1 3 m < 1 0 ) WtHBWi, U^X<0&£ 
BHSSt . F«4fcttP&fc, mt^bitzmb. U 

wk < p s p > -cfiii k £#iafc Lfcffia ( 8 ) m 
[ o 3 o 2 j we < 1 1 > mmto±mwm%x' 

S as 4 fcttflHRT* 6 £ fc Sflffifc L fctf 

E(8) E^WRSaSKiB. 

, [0303] wmzmnzmmm) mwm. 
[0304] {m-m)%&imzmm*)& 

JK-C&6. 

[0 3 0 5] 9t4. g$&ti<*SWJt. 

»«»tts*3aa-r5 k k t c. 3ffigw4sjaw». ax 

CfcT'TO:**. 

[03 06] #ie (12) A-f-iiFfilfci-f- 

>-^sftss«foc k &Mtak L^#ie ( s > mm 
wmm. 

[0307] (»JBt6iW!«Sa(W«S3a) 8 1 *)33&fe 
[0308] ( ffffl • 3«& ) m LfcSR SffiWSIR 0 52= 
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««k» £h&iz^&&<7>w&<7i*v. Gmxfsm 

f£r*6. 

[0309] £?X&&#*7(d. fflu£££*tf&v«lsSE 
*flfek&6. 

[0310J tf§H(13) a-^-*qim«(4S^ 
*«JtfS£fc*tt«fcU:ttK (S) . (12) en 

[ o 3 1 1 ) me ( 1 4 ) a-f-A<ts^i^®sa± 

^fttBSiftSSiRI-acfcfcloT. #fSJfcETC-try 

£o£ fcSftfat Ufctfffi ( 8 ) , (13) £tt0BSL 

[0 312] ttffid 5) *-T-ttf«<«3lCj: 
oTX-AffifffcTOT* 6 Z k frffttfc Lfcflffi 

1 0 3 1 3 3 (tig ( 1 6 ) X-Afl»*ftj£fr4IRv 
41\ X-AW#«Cw£fc. &6££;bii;S*3»rfriiSg 
U X-A««f*&««fc. *Ojfi«»SfMftiJB^-C. 
BfflJt0>lfc*fc, BW«m*ftt!tt**». *>6W±, » 
WtWC/<9*-**»JH*4.I k *Ffftk UfcfME 

(8) ga$ojs««Kiss. 

[0 3i4] MtttmwmiBm) #2«xm 

(0315) (ftffi*«ft)SI9UdK$flHI$D[9& 

fiWRfc. #l^t>iUP3tfl»>*T. 
£T'S6. 

[0316] £<0(SeS^>?(4, jfefe£^**tmsW 
[0317]f«E(17) X-A«HJS8«t6IK. 

*i#t«at4 c fc *mfc L*tne ( 1 e > SEsa^is 
t o 3 1 8 ] f«a ( i s ) a— if-aq&stsx-A 

^*'!l^5:tk{i. 5MS:J£At, Wffi±<0^j£<0{ii 

T«ft«+*fitBfc. x-^fls*. Ffi<ojgfi*aE*r 

IRr/t?^ -?§tf£5r3#-cc k £ttttk LfcWfi ( 8 ) 
[03 19] (^!5t6^BfloSUJfi«B<i5) ®3?)pm 



09-1 1 -25 i02:11PM;*Wffifi 



OL I FF&BERR I DGE 



;03 3502 2777 



# 22/ 28 



(t4))00-207549 (P2000-20754 9 A) 



[ o 3 2 o j um • m) mtmzmm 

t,zm&isb*tx x- 5 > . 

[03223 <#tei9> mm^frwrnbn 

[ 0 3 2 3 ] ( #IS 2 0 ) 3 vflaSfcfcfcfc . S&SLPi 
tbZZt t»ftkt*f*SB ( S) , ( 1 9 ) EftftHft 

[0324] wjBt&mp&miwm) s?4 ornrn 
[03253 muzmamm , )& 

[03 26] a-?J0UIO»#5rJR l 5 
[03 27 3 (#152 1) ©KSSWBWSrKOAfi. 

sit L^-r-tie ( s ) tmmmmm. 

[03 2S] (#322 2) mmdeo*&n&Ztf 

t sttsstt ufcttsa ( s > % (2i) immmm& 

[03293 ( *M?f * 96«W^yaSfe^SS ) 35 5 

C0330) (m • m) mimzmm 

[03313 ^<0flieS*^9(i. £JK«0>tHS*B9 A 
[03323 (#122 3) ■%%A«r)&<?> > s7 hO&S 

s-jr 1 ? AAscik strafe Lfc#ie ( s ) m.mim 



[03 333 (#i£24) ft4BW»U^)fe»tt*. 
fcttftiiW* MS $<th 1 1 SrWftfc UfcttSS ( S ) „ 



(23) ^mmmms^.. 

[03343 ( M&t ^m^mssmm m v>m& 

[03353 <m • m) mi>fc%$wmM*)& 

[03363 Z-oymtitytt.. j&Mtemiwm 
Wo. 

[033 73 (#122 5) mm&X\ZW*i\> 

[0 3 3S] (#£26) Aania**. t^-fc/wwa: 

mm ( s ) mmwmm. 

[0339] wm&m^mim) m?$m. 
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